Lip Tracking for 3D Face Registration
نویسندگان
چکیده
This paper presents a method for 3D lip registration when tracking a face model from video and depth map data. The inner and outer lip contours are tracked in 2D using features obtained from Boosted Edge Learning (BEL). Given the lip contours and a reconstructed depth map, the 3D mouth region of a mesh is registered at each frame independently, accounting for the self occlusions of the lips that occur during speech. Experiments show that this leads to significantly higher registration accuracy in the perceptually important mouth region. The proposed method is also shown to have lower error than an Active Appearance Model based registration method.
منابع مشابه
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models
An improved technique for 3D head tracking under varying illumination conditions is proposed. The head is modeled as a texture mapped cylinder. Tracking is formulated as an image registration problem in the cylinder's texture map image. The resulting dynamic texture map provides a stabilized view of the face that can be used as input to many existing 2D techniques for face recognition, facial e...
متن کاملHead Tracking via Robust Registration in Texture Map Images
A novel method for 3D head tracking in the presence of large head rotations and facial expression changes is described. Tracking is formulated in terms of color image registration in the texture map of a 3D surface model. Model appearance is recursively updated via image mosaicking in the texture map as the head orientation varies. The resulting dynamic texture map provides a stabilized view of...
متن کاملFast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Model
An improved technique for 3D head tracking under varying illumination conditions is proposed. The head is modeled as a texture mapped cylinder. Tracking is formulated as an image registration problem in the cylinder's texture map image. The resulting dynamic texture map provides a stabilized view of the face that can be used as input to many existing 2D techniques for face recognition, facial e...
متن کاملA comparative study of 2d and 3d lip tracking methods for AV ASR
Over the past two decades, many algorithms have been proposed to detect and track a human face and its facial features. Of particular interest to the Automatic Speech Recognition (ASR) community are algorithms that can track the shape of the lips, as such visual speech input can then be used in an auditoryvisual (AV) ASR system to improve the recognition accuracy of traditional audio-only ASR s...
متن کامل3D Face Tracking Using Appearance Registration and Robust Iterative Closest Point Algorithm
Recently, researchers proposed deterministic and statistical appearance-based 3D face tracking methods that can successfully tackle the image variability and drift problems. However, appearance-based methods dedicated to 3D face tracking may suffer from inaccuracies since they are not very sensitive to out-of-plane motion variations. On the other hand, the use of dense 3D facial data provided b...
متن کامل